word token
美 [wɜːrd ˈtoʊkən]英 [wɜːd ˈtəʊkən]
- 网络词用
word token
-
Then , Using isolated word token as reference pattern , a fast dynamic time warping ( FDTW ) matching procedure is perbormed .
构造出一种快速动态时间弯折(FDTW)匹配过程。
-
During the text segmentation , each word or token is determined for the lexical dictionary .
在文本分割期间,将针对词汇字典确定每个单词或标记。
-
Lexical analysis of the main tasks are : to scan source code character by character from left to right , resulting in one word ( Token ), also check the source of lexical errors .
词法分析的主要任务是:从左到右逐个字符地扫描源程序,产生一个个单词(Token),同时检查源程序中的词法错误。